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ABSTRACT 

The evaluation of the Conceptual Skills Program/ a 
curriculum program for the kindergarten, and teacher implementation 
of the program are reported. The evaluation was compriGed of three 
components. The first, an estimate of student achievement, relied 
mostly on the comparison of the performance of program objectives of 
kindergarten classes in 12 schools in which the program was initiated 
i.n the fall of 1971 with the performance of program objectives of the 
children who had immediately preceded them in the same schools and 
who had not received the program. Additional data were collected from 
the classes of teachers in the area who were teaching the program for 
the second or third year. Results indicated significantly greater 
conceptual skills achievement by students exposed to the program. The 
second component, a student attitude measure, estimated the relative 
performance of children for Conceptual Skills and seven other 
xn-and-out-of-school activities. Data were collected from all 

children receiving the program, which necessitated devising a 
group-administered attitude test for children unable to read or 
w^rite. Students ranked the Conceptual Skills Program lowest. Opinion 
data from parents, the third component, were also collected, using an 
interview-guestipnnaire technique for a random sample of parents. 
Generally, parents were well inf ormed about the program and approved 
of It. Ten teachers were observed and evaluated in their use of the • 
program. (Author/KM) 
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The development, field testing, evaluation and implementation of a 
curriculum program provide considerable and varied data to those involved in 
this kind o£ change process. This report which discusses the evaluation of a 
curriculum program and ^teacher Implementation of the program sheds some light 
on the process of effecting school change. 

The curriculum program considered is the Conceptual Skills Program 
(Bereiter-Ilegan) developed for use in the kindergarten/ The purpose of this 
program is to develop skill in the use of simple concepts. It is primarily a 
thinking program, not a language program, as it is concerned with teaching 
children to communicate ideas accurately, see relationships among concepts and 
use concepts effectively in thinking. The learning tasks and instructiD^r>al 
materials developed are intended for use in daily lessons which represer-i4 only 
a part of the total kindergarten program. 

Program Evaluation , 

The 1971-72 evaluation of the program conducted by the 'Trent Valley Centre 
was comprised of three components. The first, an estimate of student achievement, 
relied for the most part on the comparison of_the performance on the objectives 
of the program of kindergarten classes 12 schools where the program was being 
initiated in the fall of 1971, with the performance on the pbjectivesof the 
progi^am of the children who had immediately preceded them in the same schools and 
who had not received' the program. Additional: data were collected from the classes 
of teachers in the area who were teaching the program for the second or third 
year. Results indicate significantly greater (p^^<^ conceptual skills ; 

achievement on the part of students exposedto;: the^ programj (M = 21 . 42 n = ;487) ; as 
compared with comparison students (M = 19.58 n = 498) . 



The second component/Ja student attitude measure, estimated the relative 
performance of children for Conceptual Skills and seven other in-and-out of 
school activities commonly engaged in by children of this age. These data were 
collected from all children in the area whD received the program and necessitated 
the devising of a group-administered attitude test which could be used with young 
children not yet able to read or write. Although the scale used in the 
evaluation prevented absolute estimates of perference, students ranked the 
Conceptual Skills Program lowest in relation to activities , all of which may well 
have been considered enjoyable by them. 

Opinion data from parents > the third component^ were also collected using 
an interview-questionnaire technique in which randomly selected parents were 
visited and a questionnaire completed in their presence by an interviewer. 
General ly> parents were well informed about the program and approved of it. ■ 

The following discussion considers each of the evaluation components in 
more detail. The measures and procedures used in collecting the data, as well 
as methods of data analysis, are described: 

Student Achievement . 

To provide comparative data, testing on the objectives of the program was 
conducted in the fall of 1971 with children v/ho had completed kindergarten and 
were comm.encing Grade 1 in schools where the program was just being introduced 
in kindergarten. The same tests were then re-administered in June, 1972, to the 
children in the same schools who were then just completing their kindergarten , 
year. This design, the post-test, post-test time series design, permits the \ 
control of teacher, school and community variables which affect the inter- . ^ 
pretability of achievement scores and is discussed in detail in Leithwood and 
Russell (1972) . ■ ' 
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/ Each item in the set o£ 143 test items designed by the program developers 
for group testing of the objectives of the program was randomly assigned to 
one of six sub-tests, and one of these sub-tests was then randomly assigned to 
.each of the control (Grade 1/ fall 1971) and treatment (kindergarten, June 1972) 
classes. The test was administered by the classroom teacher and standarization 
was achieved through the use of taped instructions to the students and a set of 
mimeographed directions for the teachers • 

: In all but one school the same teacher taught both control and treatment 
children in kindergarten. 

Results 

The mean test score of the control children (out of a! possible 24 and, 
with one sub-test, 23 mastered objectives) was 19. 5 J and of the treatment. . 
children was 21 .42 . Analysis of variance showed this difference was highly 
significant. Children who received the program had, after approximately 
four* months less maturation, development and schooling, outperformed 
children from the same schools in the same areas with the same kindergarten 
teachers on the objectives of the program- The difference was consistent 
for all test forms, and appeared unaffected by some differences in the 
socioeconomic status of the control and' treatment children who received a 
given test form. 

Table 1 summarizes the proportions of correct responses to clusters 
of items testing the objectives of the program. On most objectives, and 
on all levels individually and combined", the treatment children performed 
better than the control children. Inspection of this table also ;shows ; 
particular objectives where the previous instruction was apparently equally 
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: TABLE \ 

Proportion Of Correct Responses To rtem Clusters Measuring 
Proqra-n Objectives In Control And Treatmant D^ta 
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as- effective as the program instruction (for example, 'it ems 5 to 8 in level 
one, testing acquisition o£ the concept of size where, out of 319 tries at 
the three items 315 correct answers were recorded by the controls, and 321 
correct answers out of 322 tries were recorded by the treatment children) 
and also particular objectives where the previous instruction was much less 
effective (for example, item 27 to 29 in level 3, testing the objectives . 
of two-part instruction following, where 116 correct responses out of 254 
tries were recorded by the controls, a proportion of .457, and 175 out of 
248 correct responses were recorded by the treatment children, a proportion 
■ ^of ,706)--: 

The results of testing a number of children whose teachers were in 
theiTr second /or third year of teaching the program were also analyzed. 
Although they also outperformed the control group, they did less well than 
the treatment group. This result was thought to indicate that longer 
experience with teaching the program, does not necessarily improve, and is 
not nqjcei^^sary to effective instruction on the program obj ectives . However, 
the data analysis also showed that the socioeconomic status, of the children 
in the classes of second year teachers.^was lower than the : treatment group 
and also lower.,- though not significantly so, than the control group. 
Ability differences could conceivably accompany this E. S. difference and 
have af fected the performance of the second year teachers V students . 

Student Attitude ■■..j 

The test devised to obtain data on this component of the evaluation 
required only that .the children examine, two at a time, projected photographs 
ofxhildren of their own age engaged in in-and, out-of-school activities typical 



for children of their age. With each pair they were asked to. choose which they 
would rather do, and to mark the square on their answer book page on the same : 
side as the pictured activity in which they would prefer to engage, Tlie test 
design permitted a comparison p£ each of the activities once with every other 
one (there were 8 activities and a total of 28 choices) and the resultant data 
permitted the calculation of scale values for each activity which estimated not 
only the ranking the children assigned to the activities^ but the distances 
between the values . Paired comparison scaling data analysis methods are outlined 
in Edwards (1957) , ; - 

The photographed activities: are listed below: 



1. 


Conceptual Skills 


2. 


Singing with the class 


3. 


Show and Tell 


4,. : 


: Painting 


5. 


Play with toys and blocks 


6. 


, Being read a story 


7. 


Outdoor play ' 


8. 


Watching TV 



Each photograph showed several children with a young female adult in brightly 
coloured clothing. In six of the photographs,- including Conceptual Skills, the 
setting was a classroom. For the last two photographs, a home setting was chosen. 
Watching TV was photographed in the living room and CXitdoor Play, a winter scene 
involving skating, sleds and a snowmobilt?, in the yard of a home. The photographs . 
were presented by means of two slide proj ectors and for the sake of standardization 
the instructions to the children were placed on tape. 



All classes Where the program was in operation were tested. All data were ^ 
checked against criteria of consistence and eliminated if it appeared that the 
child had been making choices more or less at random. (Perfect consistency is 
demonstrated by evidence that the/^favourite activity is chosen in all of the.: 
pairs in which it appears, the second rank in all but one and so on to the least 
preferred which is never chosen.) The rejected data came from children whose 
achievement test scores were somewhat, but not ; greatly, lower than that of the 
children whose data were accepted. ■ ^ • 

^ The accepted data were grouped according to three dimensioFS which, it was 
considered, could affect the attitude of the children. These were the experience 
with the program of. the teachers (first year vs. two or three years) , the 
experience of the children with a school envirorment (children who had attended 
nursery school or, following a year of kindergarten were taking the program in a 
K-1 class,' vs. those having their first experience with school) and the judged 
competence with the program of the teachers involved. 

Results 

Figure 1 shows the ranking produced by the total group and by each of 
the breakdowns noted above on a scale of normal deviates . It is apparent 
that the various breakdowns produce scalings which ^now little variation 
from each other, or from the scale values obtained using the total set of", 
data. Outdoor Play is mo5t preferred^ followed by TV and the within-school 
: activities ranked in a continuum which appears generally to be characterized 
by the amount of structure and direction inherent in the activities them-* 
■ selves. Conceptual Skills theii is the least preferred activity among the : 
eight presented to the children. 
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F IGyF^E •) - Sea I ed orderl ng of ^8 se i ected k i ndergarten-age act I v 1 1 1 es ( I nc I ud i ng 

Conceptual Skills) for divisions of the sample and for the sample overall. 



' In inteipreting this result it should be kept in mind that this scale 
: does not in itself indicate the rejection or approval of any of the 

activities, but only their ranking relative to each other. It may also be 
pointed put that the method produces a scale value for any activity which 
is a function of the proportion of children who have chosen it over all the 
others. Hence if most of the children had chosen one of them, and most had 
never chosen another, the scale itself would be several . units long. In 
this case, all the activities are clustered within a space of 0 . 60 unit 
normal deviates, i . e less . than one of the units. During the data analysis, 
it was evident that with most choices (i . e. , ;23 out of the 28) the less * 
popular activity was still chose by over 40% of the children and this is 
reflected in the short distance between the most preferred activity. Outdoor 
Play, and the least preferred. Conceptual Skills.; in other words, while 
individual children have expressed reasonably consistent preferences, there 
is no indication in the data of a very strong order of perference which is 
common to most of them. 

A test-retest reliability estimate was also made by repeating the test 
one week later in two schools. The correlation between number of choices 
of Conceptual Skills on the two occasions was 0.55. 

Parent Attitude . ^ 

."■ The parents' of six randomly selected children in each of the two -"old** 
{second or third year of the program^ and two : **new'* (fi^st year of the program) 
schools were interviewed. Generally parents were quite well informed about -the 
program and approved of it . The majority approved of the idea"of forma:! instruction 
being introduced in kindergarten. Reasons for their approval varied with the 
parents.1 preconceived ideas of what constituted ^'teaching*'- i. e. , formar instruction/ 



Thus the "progressive" parent willing to explore new ways and the strict 
disciplinarian, who differentiates between the "learning" and "play" activities 
in school, were satisfied with the content and structure of Conceptual Skills 
Program- About twor-thirds of the parents were unable to determine accurately 
whether the C onceptual Skills Program had affected their children's learning 
or achievement, or their attitude towards the school. Although most of them : 
discussed the worksheets with their children, many could not quote verbatim 
comments made by the child about his special work. Yet one half felt that the 
children approved of (liked) the Conceptual Skills Program , Only one registered 
"somewhat disapproving" attitude by their child. 

Most parents saw no objection to the use of programs which have been develo] 
by experts outside this area. Their main concern was the quality and relevance : 
of the program, - 

Summary 

The findings related to student achievement are generally consistent with 
finding of earlier evaluations (1968-69, Bereiter-Scardamalia; 1970-71, Russell 
and Leithwood) , However this evaluation represented the first attempt to obtain 
specific evidence of student and parent attitude. 

Teacher attitudes, sampled by questionnaire throughout the period of field 
trials J were generally positive. However sustained contact with teacher users 
during the field trial .period revealed certain factors critical to successful 
program implementation, . : ; . 

Preparing Teachers for Program Implementation. 

• :: Joyce (1969) observes that the acceptance, and life span of any innovation 
is largely dependent on how competent teachers feel in using or implementing the 



innovation. Teachers' feelings of competence are undoubtedly influenced by the 
extent : to which they feel, prepared to cope with the change inherent in 
implementing new programs and practices. As Eisner (1970) states, "New curricula ^ 
often demand of teachers a new way of looking at the task of instruction, and 
often require that they deal with concepts and procedures that are as new for 
them as they are for students,*' (p. 8), Tlus observation is applicable to 
demands placed on teacher users of Conceptual Skil Is . Although the simple 
concepts considered in the program are not "new'», the way in which the program ; , 
seeks to develop these concepts, and skills in usiiig these concepts, does differ'f 
more traditional approaches to these objectives. Tlie recommended instructional 
techniques are particularly '^new" to many teachers; for whom direct and systematic 
instruction represents a new way of working with kindergarten children. 

Recognizing what the; program expected "of teachers, developers attempted to 
identify the problems experienced by teachers implementing the program and, sub- 
sequently, to design an approach to inservice training; which could deal with 
these problems. Thus during four years of field, trials, developers maintained 
contact with all Conceptual Skills teachers through inservice training sessions , , 
and regularly scheduled visits to classrooms. There was also an attempt to 
identify; during the fourth year of field trials, the characteristics of teaching 
styles and kindergarten programs which seemed to distinguish between more and 
less successful implementation of Conceptual Skills .. 

\ 

Developing an Approach to Inservice Training 

For 4 years, alii Conceptual Skills teachers participated in a 2-3 day 
training period prior to implementing the program. A major objective of this 
training was developing teacher understanding of the program's purpose .and , 



objectives and how tasks, materials, n^'^^ ' strnrtional techniques were designed 
to accomplish program objectives, the problems experienced by 

teachers during the early field trx^ ..ted in one way or another to poo* or 

limited understanding of the purpose and objectives of the program. Observations 
in classrooms revealed, for example, major difficulty in planning appropriate 
daily lessons. Teachers admitted that they were not sure how to selett and 
sequence tasks in a manner that provided for the sequential development of skills. 

Lack of understanding resulted also in establishing inappropriate criteria 
for evaluating student performance and response. Frequently the criteria 
established v/ere extraneous to the objectives of the program (e.g., children were 
evaluated on how well they colored the picture of the big dog rather than on the 
ability to discriminate between the big dog and the small dog). 

Failure to implement recommended teaching procedures was a further indication: 
of limited understanding of what the program was designed to accomplish. If, 
for example, a child could identify a picture as '^having something wrong with it", 
(e.g., tree with square apples) many teachers were satisfied. They did not ask, . 
children to explain what was wrong or why it was wrong, ... explanations which 
represent the real purpose of the tasks, / : ; 

Ironically, what seemed to be interfering with teacher understanding was 
the fact that many teachers thought they did understand program purpose and 
objectives. Some suggested that Conceptual Skills Was "just another way of 
doing what I already do in my program." This conclusion seemed to result from '[ 
teachers responding to: what they perceived as the ''familiar" without considering, 
what was "new*' or "different. " Admittedly the simple concepts considered were 
not "new" to teachers and many tasks appeared similar to traditional kindergarten 
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activities. In addition, teachers found themselves in agreement with the broad 
program goals o£ teaching children to ^'thinkV* and to "communicate*" Tliese broad 
goals were, of course, compatible with those which t achers had established for 
their classroom program. 

However it was soon evident that in considering program purposes and 
objectives, many; teachers could not discuss or consider these items in other than 
fairly global terms . Teachers talked about the importance of "children learning 
to express themselves" and of "teachers providing for individual differences ." 
Yet it was difficult for teachers to talk in specific terms about specific skills 
involved in "expressing oneself" or specific provisions for particular "individual 
differences," However teachers did suggest that the Conceptual Skil Is program 
manual would be more helpful if it provided more guidance and direction for the 
teacher. Teachers stated also that developers visits to classrooms and the 
subsequent assistance provided was the "best" feature of the program. 

Thus what teachers "sa.id" and "did" relative to implementing Conceptual 
Skills supplied developers with clues as to what was interferring with teacher 
understanding of program purpose and objectives. Further the sustained contact 
with all teacher users indicated what teachers considered important in develop- 
ing their competency with the program. All of this feedback served as input to 
revising the program and to developing an inservice training package. 

The Program Manual 

It is impossible to consider what was learned about what teachers ■ 
wanted and needed without reference to the program manual, ; The first two 
editions of this manual did not provide sufficient guidance or structure 
for teachers. Although these manuals organized tasks according to levels 



of difficulty (simple to complex thinking operations) , day to day program 
planning was the teacher's responsibility,' However the final edition of 
the manual was structured to the point of outlining a sequence of daily 
lessons within each pro ^ level. As might be expected, teachersu 
the program for the fi rst me tended to follow the manual closely. During 
the second year, these teachers did not rely as extensiVily on the manual , 
and many began developing their '^own" tasks and materials for use in 
Conceptual Skill s lessons. In the words of one teacher, ''I really learned 
about the program from following the manual during the first year. This V 
sentiment was expressed by many teachers and suggests that program manuals 
can be designed to provide an effective and sustained training input for ■ 
teachers implementing a new program. 

What was observed, and supported in teacher statements, suggests that 
it may be realistic to think of the first encounter with a new program as 
a learning experience for the teacher. As the teacher is learning and 
finding his way, he may not be accommodating to group or individual need to 
the extent desired. However if the ; new program is basically sound and if 
teachers are provided with guidance, it is likely children wilT benefit,; / : 
Children in Conceptual Skills classrooms showed, consistently, gains in 
concept learning and skill mastery. 

The Training Package ' 

* The attempt to develop ways and means of promoting better teacher 
understanding of the program's purpose and objectives resulted in the : 
development of a "training package," The package consists of two films 
and a manual which suggests the format and procedures for thrjee consecutive 



training sessions . The manual includes, as well i materials to be 
reproduced for teacher participants. The films and all other materials 
focus on analyzing learning tasks, materials and instructional techniques 
in relation to the purpose and objectives of the program. 

Each i. u ^ cular objective but both show teachers working 

with children in the context of the Conceptual Skills Program . The first 
film, ^Explaining the.Conceptual Skills Program/' demonstrates the progression 
of learning tasks from learning basic meanings to applying concepts in ; 
increasingly more compleix tasks . Attention is given as well to how the . 
materials being used support the purpose of the task. The film is developed 
in a way which permits "stopping" the film at given points for teacher; 
comment and discussion. In fact the training manual suggests appropriate • 
"stopping" points and provides questions to be considered in analyzing a 
particular segment (e.g. What are the communication skills that the program 
seeks to develop?) The training manual also "spells out'^ procedures for 
using the program manual to elaborate on information presented in the film. 
In studying the film and program manual, particular attention is given to 
involving teachers in a consideration of why a given task is more or less 
complex than another ((e . g. , What does a child need to know to handle this • ■ 
task? If children had difficulty with this task, you could drop back to an 
easier one; which one would you choose?) 

In addition to suggestions for considering specific tasks and materials, 
the: training activities built around the first film include suggestions for; 
involving teachers in discussing how Conceptual Skills contrasts with the 
approach to concept development which the teacher has been using. How is • 
it the same? How is it different? 



. . The second film, ''Teaching the Conceptual Skills Prbgram'', focuses on 
developing an understanding of the purpose of recommended teaching techniques. 
This film, as the first, was developed to permit study of what/is observed. 
Again, the training manual provides suggestions for using the film^^^ f^ 
purposes (e . g. , discussion questions such as "IVhat did Billy's response 
indicate to the teacher?"; "What steps did the teacher take in remediating 
this error?" "How did the teacher; probe Lucy' s understanding in this task?") - 

• ■ ; ^ As a supplement to this 'film, the training manual includes a set of 
simulation materials. These materials present teachers with problems and 
: situations to consider and discuss . One set of "problems" , which describe 
"individual differences" in understanding and behavior, require teachers 
to answer the question, 'mat could (or should) the teacher do in this 
situation?" A second set of "problems" require teachers to suggest how 
they w6uld go about remediating specific errors in children's responses 
(e.g., child who is confusing "left" and "right") . : 

Because the films and, other training .materials were developed' during 
the third year of field trials, it was possible to "test" their effectiveness 
during the fourth year of program trials Teacher response in training 
, sessions and follow up observations in the classrooms of "new" teachers ^ ^ 
indicated that the materials and procedures encompassed in the training 
package were effective in "getting at'V some of the previously experienced 
problems of many "new" teacher users, of the program. 

Assessing Teacher Implimentation • 

, The improvement in teacher training and the sustained contact between the 
developers and users of the program resulted in increasingly more effective 



program aiiipleii^ent ation. ^ Nevertheless there were indications that the prograiD 
wa,5 *'going better'! in some classrooms than in othe In some classrooms, lessons 
♦'moved along'' with the obvious interest and involvement o£ all children. In 
: other classrooms, a more "plodding" pace was- observed with response opportunities; 
provided for fewer children. . • 

There were also indications that in some classrooms, more than in others, 
^ Conceptual Skills lessons represented a better "fit" with the total classroom . 

• program. For one thing/ the ease withwhicK- some, children approached Conceptual 
\ Skills lessons suggested that these lessons did not set expectat-i nn<^ nr -regiH-rfi 

behavior that differed significantly from what was expected or required in other 
aspects of their daily program. Similarly some teacliers, more than others, 
reported .incidents of how what was considered in Conceptual Skills lessons 
"transferred" (teachers* term) to other activities; carried forward in the class- 
room. These observations and others suggested that the implementation of 
, ;r ■ Conceptual Skills was influenced by the kind of expectations, objectives and 

. • . program priorities which teachers established for their total program. Although 

^ it is widely recognized and accepted that this. is -the case in implementing any . 

■ ■■-''■■y\r: innovative program or practice, there was interest in determining what factors 

or conditions discriminated between more and less successful implementation of 
; ■ :| the Conceptual Skills: Program . To this end ^ a small classroom observation study • 

■■k was carried forward. 

; ' ' 'I 

i; The programs of ten teachers were identified for study . The manpower 

I available dictated the number of classroom programs that could be studied in any. 

::, I : detail. In selecting the ten classrooms .attention was given to including examples 

•« ' of what represented in developers '/judgments "good", "adequate" and "poor" 

- '; ' implementation of the C onceptual Skills Program . The teachers in this sample 
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included those ^'experienced** with Conceptual Skills and those using it for the 
first time. : Five half day observations were scheduled in the classroom of each 
teacher. Each observation included observing and assessing teacher performance 
during the Concep^^ual Skills lesson and/ observing and describing selected aspects 
^of the remaining classroom program. The same two members of the de\^i]f;p 
team (observer 1 and observer 2) were responsible for all observations in all 
classrooms. Both observers were involved in assessing teacher performance during 
the Conceptual Skills lesson; observer 2 was responsible for observing and 
describing the remaining daily program in all classrooms. 

Figure 2 presents the Teacher Evaluatio n rating form used in assessing 
teacher performance during Conceptual Skills lessons. Appendix A contains the 
guide and criteria used in determining the ratings for each of the six items. ^ 
Both observers observed the same teacher simultaneously but each observer 
completed his ranking independently of the other observer. Results supported 
the hypothesized range of teacher implementation (poor-good) considered to be : 
present in the sample. As revealed in the data, there was no necessary correla- 
tion in this sample between '^experience*' and the degree of success in implementing 
the. program. The" data indicated, also, that a teacher tended to achieve a higher 
or lower rating, on all items suggesting that the cluster of behaviors identified 
on the rating form was more or less easily implemented by a given teacher. These 
results suggest that the teaching behaviors identified on the.. rating form were 
more compatible with the established teaching"style" or behavior of some teachers 
than others. 

Figure 5 lists the items considered on the Observation Record used in 
describing the remaining classroom program. Appendix B contains a sample 
Observation Record which presents the information recorded in an actual 



FIGURE 2 ■ 
Teacher Evaluation - Conceptual Skills Proprram 

The teacher involves the entire group by - 

■ --setting the expectation of everyone participating/ listening : 
and thinking ^ 

--giving the group time to think before namirip whoever is to 
respond 

— varying group and individual responses 
••^ requiirimg everyone to do his. own^^w^ 

The teacher supports her children as needed by - 

modelling new work' 

— verifying work 

checking , the children Is work 

stepping in to cleam up misunderstandings thereby not allowing 
a. child or :the group to practice errors. 

The teacher giy/es her children responsibility' by - 

— dlearly setting expectations^ and following thTOugh positively 
~ ceasing to provi# a model as soon as the children can work 

correctly without it 

— giving the children .maay opportunities tO) talk " 
— . asking the children to evaluate th^^ ■ 

~ asking the childrei^ m just3ify theix .choices (whenever appropriate) 

— asking the children tw think of othex possibilities (whenever ■ 
apjpropriate) 

requiring the chiMreni to hraidle matsarials quickly and in response 
to specific instructi^sms » 

The teacher enables the children to vort at a sucxness level by - 

wot^king at a level of difficulty that: is cJraLlenging to most ^ 
of the children , 

: - V — yajg^ing expectations for intiividual xhildren according to their 

■ -abfillities- ■■■■ 'V... , 

./ probing the children^'s und^tanding hy careful questioning 

to get at- all the elements o£ the task 
: -~ trying tO' find a reason for copying and trying to eliminate the 

■ ■ ■ cause;. 

The teacher remediates effectiveiy by - 

-- spotting errors that are majie •• 
: _ — determining the cause of ernors and leading the children to ' 
understamding 

modelliiag oiUy when absolut*^^^^ 
-- remediairing quickly so as not^ "lose" the group 
: — providiBig practice fpr speciiisc difficulties 
,: — keeping the remediation positxAje (emphasizing the idea of working 

hard to get correct as opposed Ito the idea, that an error,;has been mad( 

The teacHi^ understands tSae intent «;£ each task and almx.Wj works to achieve its 

• , ; |§ii?pose.'; .-^^-■^.^ , ^ ^, ■ . ^ , 
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FIGURE 3 , , 

■ ■/ Observation ReQerd ^ 

1. Schedule of activities observed. 

2. Proportion of total group, small group/ indiv^ 

3 ' Nature of tasks, materials etc. for individual and/or small ^group^ ; . 
' ' activity f(e.g. , what is available for: children to choose and/or what 

■does teacher outline for individual or^^^s^^^^^^ 

4 Selection and performance of : individual and/ small groufi^asks (e.g. , 
is choice cMid selected or. teacher,selected, p.r6por^^^^ 

■ ■to.^^Vgroup activity) 

5 : V Teacher role during individual/small group activity (e . g. , what does 
^ the teacher d£, how does she interact with children^ : ^ 

6^ Nature of tcasks for total group activity^^^C^^^^ 

7 Selection and performance of ^t 
*: decides whal: to "do," can child decide not to participate) . 

«■ Teacher role in total group activities -[e.g., what does the teacher do^ \ 
how does sfte interact with children) . 
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observation. When the descriptions collected on the Observation Record were - 
; compared wi th; the ratings obt ained on the Teacher Evaluation forms . the comparison 
/revealed that all itenis on the Observation Record discriminated to ■.n,np-;>.vt.nf ; 
:^between programs of the 5 teachers achieving "higher" rating on the Teacher ' ; 
Ev aluation form and the 5 teachers achieving the ••lower'' ratings . Comparison of 
. the programs of "higher" and "lower" rated teachers indicated differences in 
1) the selection and ordering of activities foir the daily program 2) the program 
priorities which seemed'to be established 3) the e;<pectations which seemed to ■ 
be held for children. 

The following discusses the limitations of the study, describes the analysis 
of the data, and reports the findings in more detail. 

Limitations of the St udy 

, The instruments used in collecting the data suffer from certain obvious 
limitations. The four points rating scale used in the Teacher Evaluation form 
does not properly reveal either the extremes or the range of differences between - 
a rating of 1 and 4. Nevertheless since it does permit discrimination between 
satisfactory (adequate-good) and unsatisfactory (weak-poor) teacher performance 
during Conceptual Skills lessons, it . was considered adequate- f^Di^^ the purposes of 
the study. 

The Obseijvation Record also suffers from limitations but again it was 
considered adequate for the purposes of the study. For the most part, the i:tems 
on the Observation Record involve the observer in describing the nature of 
activities, materials and organizational patterns in classrooms - similar to a 
counting procedure. Some items, admittedly, focus on interaction patterns. ■ 
However these items are concerned with describing and not evaluating the inter- 
■ action. , ■ 



A final limitation was one experienced by most educators who attempt to 
/collect data in the "real world" o£ the school. This "limitation': refers to the 
conditions which interfere with collecting air the data desired. In this, study, 
it was necessary to devise and conform to a precise observation schedule. Due - 
to such factors as teachejT illness, observer: illness, inclement "travel weather" • 
•for observers, and situations arising in 'schools (e.g., special programs) , some 
observations could not proceed as planned on the day scheduled. Further, in 
most instances,,,, it was not possible to "make up" the observation. As a result, 
for four of the ten classrooms, only three "full" observations were made (i.e. , 
observation of Conceptual Skills by both observers and observation of remaining 
program). There was some concern that, especially for Conceptual Skills lessons . 
scores, might be unduly affected by a small number of observations, since a chance 
occurrence (e.g., a "bad day") could have a larger effect on a teacher's mean 
score than if five observations had been made. However, inspection of the data 
ruled this possibility. out as far as the present study is concerned, since the 
scores for these four teachers showed a great deal of consistency. 

Although mean scores might have been slightly higher or lower if all 
observations had been made, the teachers' assignment to :the "high" Or "low" group 
would have been the same. It was decided, then, that the small numbers of 
observations would have little effect, if any, on the results of this study. 

The data on classroom observations were more complete; A total of 22 
observations were completed in the classrooms of the 5 teachers obtaining the ^ 
highest mean rating on the Teacher Evaluation form; a total of 22 observations 
were...:Uikewise obtained in classrooms Of the 5 teachers obtaining the lowest ' 
mean; -ratikigs . . . 
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Teacher Implementation of Conceptual Skills 

Because the .items on the Teacher Evaluation form reflect the emphasis of 
teacher training sessions, the instrument was considered a valid means of 
assessing teacher performance in implementing the Conceptual Skills Program ^ 
Tables 2 and 3 show that when the ratings of the two observers are analyzed by 
item and by teacher, observer agreement is generally high. Nevertheless Table 2 , 
suggests that although observers wer^ using similar criteria in rating pierformance 
on a particular item, agreement was noticeably higher^ for some items than others. 
However the degree of observer agreement on item 6, "over all assessment'V of what 
was observed, indicates that observers agreed rather consistently that a teacher's' 
general performance was **good", **adequate", "weak*' or "poor" in relation to the : 
purpose and intent of the program. 



OBSERVER AGREEMENT BY ITEM 

o " ■ 



ITEM 


-PAIRS OF RATINGS : 


SA^iE 




DIFFERENT 




1 : 


37 


22 


59.5 


15 


40.5 


2 


37 


24 


64.9 


. 13 


35.1 


3 


■ ■•37' 


27 


73.0 


10 


27.0 


4 


37 


25 


67.6 


12 


32.4 


5 


37 


27 


73.0 


10 


27.0 


6 


37 


28 


75.7 


9 


24.3 


TOTAL 


■ 222 


153 


68.9 


69 


31.1 
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Table 3 shows that when the ratings of the two observers are analyzed by 
teacher, observer agreement is higher for some teachers than others. However 
observer agreement is still generally high for the total sample. The observers' 
discussion of these results suggested that in their ratings of some teachers on 
some items, a difference in ratings reflected different observer reaction to 
such- things -as "noise level" in the classroom and certain personality traits of 
the teacher. These observer biases were acknowledged, particularly,- in discussing 
the performance of teachers 303 and ICIO. 

T A B L E 3 

Observer agreement for each teacher 



TEACHER 


PAIRS OF RATINGS 


SAME 




DIFFERENT 




, . 101 


18 


17 


94; 4 


1 


5.6 


202 


18 


15 


83.3 




16.7 


303 


24 


10 


41.7 


14 


58.3 


. , , 404 


24 . , 


17 


70.8 


7 


29.2 




18 . 


11 


61.1 


7 


38.9 


606 - „ 


18 • 


14 


77.8 


4 


22.2 


, 707 


24 


15 ■ 


62.5 


9 


37.5 


808 


■ , , ■■ • :24'':- ■ 


20 


83.3 


4 


16.7 


■ , 909 


30 


21 


70.0 


9 


30.0 


! ,1010 


24 


13 


54.1 


11 


45.8 


TOTAL 


222 


153 


68.9 ■ 


69 


31.1 
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Table 4^ shows that when the mean total group ratings are analyzed according 
to the first 5 items, teachers as a group did not tend to obtain a higher rating 
on some items than on others. Although there are some differences in the mean 
ratings of items, these differences are small. Seemingly then there were no 
specific teaching techniques or procedures which were consistently more difficult 
or easy for all teachers to implement. 

t A B 1. E 4 

MEAN SCORE ON EACH ITEM FOR TOTAL GROUP OF TEACHERS ; 

ITEM NUMBER OF RATINGS TOTAL POINTS ' X 

2.50 
2.86 
2.73 
2.74 . 
2.62 



Table 5 shows that when the mean rating for each teacher on the total of 
items 1-5 is tabulated, the resulting ranking of teachers supports the hypothesiz 
range of teacher performance in impl ementing Conceptual Skil Is considered to be 
present in the sample. With the exception of one set of tied ranks teache.x 
ratings fall at a different point along the range from generally poor (1.35) to ; 
generally good (3.83) program implementation. 



1 . 74 185 

2 74 212 

3 74 202 

4 74 203 

5 74 194 
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Table 6 shows that when a teacher's mean rating on the total of items 1-5 
(average of all ratings on all 5 teaching behaviors) is compared with teacher's 
mean rating on item 6 (average of all ratings of general performance) the mean 
for item -6 is somewhat higher than the mean for items 1-5 for 6 teachers; some- 
what lower for 4 teachers. However inspection of the two sets of means suggests 
that observers' general assessment of a teacher's performance (Mean, item 6) 
reflected the assessment derived from averaging the ratings obtained for particular 
items (Mean, items 1-5). Although each set of means produces a different ranking, 
.what is involved is a change in relative position for- some teachers in the group 
obtaiining the 5 highest ratings and some teachers in the group obtaining the 5 
lowest ratings. Both sets of rankings perndt identification of the same 5 
teachers (101, 202, 404, 606, 808) as the "high" group and the same 5 teachers 
(303, 505, 707, 909, 1010) . as the ''low'Vgroup. 

T A'.'B;l"e;. 5' ' 

MEAN SCORE FOR EACH TEACHER ON EACH ITEM' 
AND TEACHER RANK ON TOTAL 1-5 



^ TEACHE7: 


■ ■ 1 . ■ . 


2 


I T 

■;3; 


E M : 

4vy,^:-, 






RANK 


r 101 


3.00 


3.33 


3.33 


3.17 


3.33 


3.23 


2 




3.50 


4.00 


3.83 


4.00 


4.00 


3.87 


1 




2.38 


2.75 


2.50 


• 2.75 


2.63 


2.60 


7 




2.88. 


3.63 


3.50 


2.88 


3.13 


3.20 


3.5 




2.17 


1.83 


2.00 


1.83 


1.83 


1.93 


9 


606 


2.50 . 


3.33 


' 3.33 


3.33 


3.17 


3.13 


5 ■ 




1.25 


1.38 


1.50 


1.50 


1.13 


1.35 


10 




, 2.75 


3.50 


3.38 


3:38 


3.00 


3.20 


3.5 


; 1 909 


2.00 


2.40 


1.70 


2.10 


2.10 


2.06 




"Sl^^ 1010 


3.00 


2.88 


2.88 


3.00 


2.50 


2.85 • 
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T A B L E 6 



COMPARISON OF TEACHER RANKINGS ON MEAN SCORE FOR 
TOTAL OF ITEMS 1-5 AND MEAN SCORE FOR ITEM 6 





I T E M 


1-5 




IT EM 


0 


TEACHER 


X 


• RANK 


TEAaiER 


X 


RANK 


101 


3.23 


2 


101 


3.33 


3.5 


202 


3.87 


1 


202 


3.83 


1 


303 


2.60 


7 


303 


3.00 


6 


404 


3.20 


3.5 


404 


3.13 


5 


505 


1.93 


9 


505 


2.17 


8 


606 


3.13 


5 


606 


3.33 


3.5 


707 


1.35 


10 


707 


1.38 


10 


808 


3.20 


3.5 


808 


3.50 - 


■2- 


909 


2.06 


8 


909 


2.00 


9 


1010 


2.85 


6 


1010 


2.63 
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Classroom Observation Record 

It is important to note that what is reported concerning the programs of 
the two teacher groups (''high" and "low") reflects the predominating trends -1^',:', 
revealed in inspecting the Observation Records for each group. Further the labels 
"high" -and "low" refer respectively and exclusively to high and low ratings of 
Vteacher success in implementation of the Conceptual Skills Program; , 
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Programs in the classrooms o£ the'high teacher group suggested a generally 
systematic approach to program planning and implementation. Daily programs 
appeared to be planned according to a format which gave attention to ordering 
and balancing activities in a way which estlfclished daily routines but, at the 
same time, permitted variety within each da^t' as well as variety from day to day. 
Whereas the time of a given activity (e.g., activity period) varied little from 
day to day, variety was provided within the activities and materials available 
to children. Another dimension of a systematic approach in these classrooms was 
revealed in teacher practices of (1) introducing, explaining, discussing "new»' 
materials or equipment, (2) making sure children understood what activities were 
available to them and/or suggesting activities that could be pursued (5) in- 
troducing, reinforcing or reviewing information, concepts, skills through direct 
instruction which included checking children's understanding. 

With respect to program priorities, the programs of teachers in the"higlV 
group suggested concern for (1) helping children to develop "work habits'' or 
skills which contribute to more independent school behaviors (2) helping children 
to develop language and number concepts and skills as an aspect of developing 
"readiness" and (3) providing children with a variety of experiences and materials 
in the areas of music, art and literature. In contrast to programs of teachers 
in the low group, more "readiness" materials and activities were available and . 
more attention was given to instructing children in the use and handling of 
■vmaterials'.- 'J''-:': '^y]'' /j''; 

■ In these classrooms these priorities were reflected in the kind as well as 
:;the amount of ; materials and activities available, and in the teacher 's ripproa^ch-; 
to working with children. In these respects, it is difficult to separate the 

suggested priorities, from the expectations' which seemed to be held for children. 



The design and implementation o£ programs o£ teachers in the'high group 
suggested the point o£ view that with tocher guidance and support (1) children 
are capable of assuming some responsibility £ox their behavior (2) children are 
capabile o£ leazning a number o£ concepts and skills as preparations £or later 
encounters with: the ^'academic" program o£ the school (3) children are capable o£ 
"choosing" and/cor establishing some o£ their own purposes £or learning. 0£ 
particular note is the observation that: szhildren in these classrooms tended to 
assume responsibility £or such things as getting their own materials, "cleaning 
up" or putting things away, suggesting or "deciding" what activity could be 
pursued with what material , choosing "another" activity when one task or activity 
was completed, responding quickly and easily to teacher requests to join with 
the total group and getting themselves "ready" to go to the library, the gym- 
nasium or "ready^to go home. For example, in contrast to children in classrooms 
of the low teacher group, children in classrooms o£ the higfi' teacher group 
required much less time and much less teacher assistance in "dressing" themselves 
to go out doors. 

The programs . o£ teachers in the'*hig'n group might be described in the idiom 
o£ the day as being somewhat "structured." The selection o£ activities and 
materials available, the ways in which teachers, worked with children and the 
behaviors and responses of children, did suggest that programs were planned and 
implemented according to particular objectives and expectations. 

. In comparison with;programs o£ teachers in the '^ligli group, programs o£ 
teachers: in the low group seemed to; reflect a less systematic approach to pi a.n- 
ning. and implementation. With respect to ordering or scheduling activities, ; ; 
decisions appeared tO; be more spontaneous than planned. In contrast to programs 
of the high group, no particular program format was suggested; An ^activity period 
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might be provided on d^'tbu^^ on another. This period might constitute, 
the first activity o£ %£ W limited to the last 10 miiimt^s of the day. 
As a rule, daily progfs^iJis nOt f^^J±de either the balanc^ mimber or variety 
of activities observed in ciass^o^jg^ of teachers in thejhigf^ group. In terms of 
working or interacting Mth m.ld:^^ teachers in the "low' group employed less 
direct guidance or in^^ct£M^ th^ :^e^^eTS in the'liigll' group. It should be . 
noted, however, that ji^: asa^s th^se -cUssrooms, there was a considerable amount 
of teacher -telling.-' Hme^f^^ th^ j^u^e of the telling (e.g. , telling .children 
what to do, reprimanding cchildren) would not be properly labelled .-instruction." 

With respect to program Prio^^ities, there appeared to be some differences 
among the teachers in the "low gr^Up. For example, one teacher's chief priority 
. seemed to be permitting children to e^cejcise as much freedom as possible in 

deciding what to do. and when to do it. Child "choice- was generally pursued with 
a very minimum of teacn^r guidance oi> involvement. A second teacher tended to 
make all choices for aU childrer^ an of the ti^e. m this latter instance the 
priority seemed to :be getting ch^tldren to follow directions . In the classrooms 
of the other teachers in the"low' g3roup it was difficult to detect, from what was 
observed, what constituted program priorities . The materials, activities a^d 
■ approaches to working With^^c^^^^^^ in these classrooms did not reveal a program 
pattern or plan which>ight SUgg^sV priorities . There was, however, a consistent 
feature in all of these clasSroorHS which related to expectations held for children 

IVhereas teachers in the '^o^J' gj^oup engaged in less teaching or instruction 
■ than teachers in the "hi gU' group, they devoted much more time to "waiting on" 

children and. controlling "iunaccepMble" behavior- Evidently Aese teachers did • 
. .not expect children to is5Pon#Me for getting their own::m3Eterials, "cleaning 
,., up" after themselves, ^^e^tij^ dre^ed to go outside and the me. These teachers 
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devoted much time to "servicing" children in these respects. Likewise children 

in these classrooms seemed to assume little responsibility for other aspects o£ 
■ their behavior. From teacher remarks and reprimands there was some indication 

that certain "rules" and expectations for behavior has been outlined, but were 
generally ignored. Of particular note were the numbers of chxldren who. either 
"didn't know" or couldn't decide what they could "do" when permitted a free 
choice of activity. Such children spent considerable time waiidering around the 
room. 

The similarity of program among teachers in the"higfi group, did not exist 

in the same degree among the programs of the teachers in the "low' group. In terms 

. of "structure" both extremes were observed in classrooms of teachers in the "low' 

g^o"Pv However in comparison to programs of teachers in the' Mgh' group, , ,th^ 
programs of all teachers in the "low" group appeared to have fewer and less clearly 
defined objectives . 

S U M M A R Y 

The evaluation of the Conceptual Skills Program included attenf i nn i-n 
evaluating student achievement, student attitude, parent attitude, approaches 
to preparing -.eacher users of the program, and attempts at program implementation. 
As a result of this fairly comprehensive evaluation of the program, there is 
: which CD shows that the program is effective in terms of its objectives, 

in promoting student achievement (2) indicates student, parent .and teacher 

program and (3) suggests what is required for implementing the 
• program successfully. All of thes6 findings are considered by the developers as 
^ insights relative to the process of producing change in schdols. 
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Appendix a 
rating guide for conceptual skills observations 



Each observer will give a rating to each of the first five categories. 
These include: 

The teacher involves the entire group. 

The teacher supports her children as needed. 

The teacher gives her children responsibility. 

The teacher enables the children to work at a success level. 

The teacher remediates effectively . 

Rating ofrthese categories will be according to the following scale: : 

1, poor, clearly inadequate in handling the items 
specified under the given category; - 

2. weak, needs improvement in handling the items 
specified under the given category; 

. 3. adequate, generally meets basic requirements in 

, handling items specified under given category; 

4:. good, consistently meets basic requirements in handling 
items specified under given category. 

The rating for the sixth category - The teacher understands the intent of each 
task and clearly works to achieve its, purpo se - will indicate the observer 's 
oyer alL assessment of ..the extent to which the teacher *s performance reflects 
an i^^^ of the program. ; Rating will be according to 

the following scale:. 

: - ; 1. poor and seemingly distorted understanding of what; 

the program is attempting to achieve with respect 
to pupil understanding ;and behavior; seemingly no 



- 2 - 



attempt to evaluate what is happening during lesson; 

2. weak and seemingly only partial understanding of what 
the program is attempting to achieve with respect to 
pupil understanding and behavior; few attempts to 
evaluate what is happening during lesson; 

3. adequate understanding of what the program is attempt- 
ing to achieve with respect to pupil understanding and 
behavior but needs to improve in evaluating what is 
happening during lesson; 

4. good understanding of what the program is attempting 
to achieve with. respect to pupil understanding and 
behavior; fairly consistent in evaluating what is 
happening during lesson. 



APPENDIX B 
Observation Record 



Observer: 
Teacher : 
Date: 



a.m. session: X 9:00-11:15 



p.m. session: 



S chedule of activities observed 

Opening exercise and Calendar 

Conceptual Skills 

Activity period 

Music (Songs) 

Recess 

Reading Readiness Activity- 
Music -Rhythms 
Story 



Proportion of: total'" ryroup, small group, individual activity 

Activity period provided opportunities for small group 
and individual activity. Three.small groups of 2-4 children 
did work and play together during this period.. The remaining 
children worked independently. All other activities werentotal 
;group' ^oriented. V ■ V- V'V,. .. -'^r/i--^::'.^'' .•' 



3. Nature of tasks, materials etc. for individual and/or small Z^oup 
' activity (e.?z., what is available for children to choose and/or 
what does teacher outline for individual or small proup activity) 

. The following were available during Activity period: 

Art materials including buttons, yarn, cotton, sticks, 
cardboard boxes, paper, paste. . 

Paints 

Workbench and Housekeeping Corner 

Blocks and Block games - e.g., sequence games. 

Readiness Worksheets which included many different number 
oriented sheets - e.g. , Drawing a specified number of figures, . ^ 

Identifying given sets of objects, matching number sets etc., a 
phonics oriented sheet for identifying objects beginning like 
"dog'*, classification oriented sheets -^ e.g., identifying pictures 
which depict Fall or Spring, identifying objects that belong to 
mother, father, child etc. 

Printing center materials which included models for printing 
: numerals, words and short phrases to be printed - words and phrases 

related to Spring theme. . . . / 

4. Se lection and performance of individual ,and/or snail ^roup tasks 
(e.i; . , is choice child selected or teachef selected, proportion 
of individual to group activity) 

The teacher introduced the Activity period by explaining, to the 
total group, two^'new*' readiness worksheets i.e. , what the worksheet 
task required. She then outlined the different activities available 
and children were allowed to make their own selections. However during 
the period, the teacher checked to make sure that each child spent a 
portion of the period at what she terms V'hand work" - which seems to ^ 
include any activity involving materials (e.g., paper, paint , worksheets) ^ 
as opposed to objects (e.g. / games, toys, blocks) , Most children engaged^. | 
in no more than two activities during the period and tended to "stay with"! 
a given activity for a reasonable period of time. Some children spent 4 
the entire period with readiness materials; others with art materials. : | 
Children at the housekeeping corner, workbench and blocks really worked j 
or played together i.e., planning what they were going to do, interacting , 
with each other etc. This group activity involved approximately 8-10 \ 
children, the remaining 10-12 worked independently at tasks. j 
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5 . Teacher role during individual/snail group activity (e . f? . , what 
does the teacher d£, how does she interact with children) 

The teacher moved froni group to group and child to child 
during the period - asking chilcjren what they were doing (or 
making), suggesting (e.g., Can -you think of something else you 
could put in that picture, something else you see at the lake?) 
Checking worksheets and remediating errors, printing stories on 
pictures and the like. When a child sought out the-teacher to 
show her something, she frequently responded with questions or 
coinnients which required an "expanded'* description or response 
from the child'(e.g.. What else can you tell me about this flower 
you made - KHi at shape is this? Can you tell me something else 
about this picture? etc.) The teacher also used this period to 
''check withT individual children relative to incorrect responses 
.given during the Conceptual Skills lesson. 



6t Nature of tasks for total group activity (exclusive of Conceptual Skills) 

The first Music period included identifying a given song from 
a few bars played on the piano and then singing the songs . A second 
. activity included singing about and dramatizing a song about riding 
on a bus. There was some discussion about what comes next (e.g.j, 
sequence) on the bus ride. 

The Reading Readiness activity involved identifying the beginning 
sound and/or letter in words presented by the teacher. Model words 
and picture (e.g., b^all, t^op, moon etcO were in view^o 
and they were encouraged to repeat word the teacher gave and then look 
: for a word on the chart beginning with the same sound or letter. 

Since the circus was in town, tlfe teacher presented ''circus words" - 
I e.g., tent, balloon etc. The ''children" received a point for each correct 
V: response. The "teacher" received a point- for each incorrect response 

from the group. The children won the game 1 1 

The second music activity involved listening first to a record to 
decide what the music "tells us to do" (e.g., skip, walk, march etc.) 
and then doing it as the record played. 




The "Stbr/*' activity focused on the animals and people in the 
circus but also focused on number concepts ~ e.g., 8 clowns, 9 seals 
etc. The teacher showed each page to the group who identified the 
people and animals (with some discussion - e.g., what acrobats do, 
fact that zebras have stripes etc.) and counted the number of people 
or animals shown. • 



Selection -and performance of tasks in total rroup activities (e,R. , 
who decides v/hat to • 'do", can child .-iecide not to participate) 

. The teacher decided what was to be done but children had 
i^any opportunities to ^'participate*' i. e. , comment , ask questions 
etc. All children were expected to participate and did. 



• Teacher role in total group activities ie\<i, , vliat does the teacher do, 
how does she interact v/itli children) 

The teacher began each total group activity by explaining 
what was to be done or; establishing a purpose for the activity. 
She gave children many; opportunities to respond but kept responses 
focused on the task at hand. When individual chi Idren gave an 
incorrect or ^'hazy" response; she "moved in" to remediate the 
problem - this was especially true in the Reading Readiness activity. 
She also differentiated her expectations for individual children. 
For example, children who were not able to identify a beginning letter 
or sound were encouraged to point to the model picture which "began" 
like the teacher*s "word." 



